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(54) Card type recording medium, certifying method and apparatus for the recording medium, 
forming system for recording medium, enciphering system, decoder therefor, and recording 
medium 



(57) In a card type recording medium containing a 
data area where data containing ID information of a 
holder are recorded, and an image area where image 
data are recorded, in the image area are recorded sec- 
ond image data which are generated by transforming 



first image data specifying the holder to frequency-area 
data, adding the transformed frequency-area data with 
the ID information and inversely transforming the added 
data to image signals. 
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The present .nvention relates to a card type recording^ddiup containing a magnetic card such as a credit card a 
cash card, an .dentification (ID) card or the like, and particularly to a certifying method for certifying whether owner's 
5?' d J yp ? r ® cord,n ? medium is * ru e or not. a card type recording medium enciphering system for enciphering ID (Iden- 
rf.cat.on) .nformation recorded on a magnetic card, a card type recording medium in which personal data (which are 

^rmTnT^H^ 3 ^ 16 ' ^ ? nd 3 P not09ra P n of tne face of a "ser are recorded, and a recording medium in which 
a forming method and an enc.pher.ng method for the card type recording medium are recorded as computer programs 
Japanese Laid-open Patent Application No. Sho-64-76270 discloses one of techniques for verifying a true owner 

nlw^H?n C ? T a ! 3 ^ Card ' 9 C3Sh Card ° r the ,ike ' and 0ne of ^ciphering systems for enciphering mag- 
netic card ID .nformafon. According to the technique and the enciphering system as disclosed in the above publication 

lu IS!" r anCC Wh6n 3 h ° lder ° f 3 ma9netic card such as a credit a ««* card or the like is confirmed,' 

value information such as an amount of money to be drawn out, ID information which is desired to be recorded as mao- 

1rt^??° n T £ 8 T 9 ul C Card ' 6tC - afe enci P hered and ^corded in the magnetic card in advance. In order to 
ac ually confirm whether the holder of the magnetic card is a true owner or not, the ID information recorded in the mag- 
" 6 S! S d , ecod ^ ,r ° m * ne magnetic card, and compared with ID information which is separately and directly input 
^fe?rei to ^s °™p!\or artT ° f iS ^ Wm8r ° r n0t - ^ P ublication is hereinafter 

Fig. 20 is a block diagram showing a conventional magnetic card ID information enciphering system 
The operation of the conventional magnetic card ID information enciphering system will be described with refer- 
sncs to ricj. 20. 

«»«SS£I?I5 me£ r S 7 l enciphers ,D in, °rmation 71 (encipherment may be performed in any one of various ways) 
so that the D .nfc.rmat.on data cannot be easily analyzed by merely reading out the magnetic information of the ID infor- 
nhJ ^ 2 • ? m 6 T 9netl ° ■ Ca " 4 Ma9 " etiC information formin 9 means 73 records the magnetic information (end- 
like) on melag n neTc n c5d nera ^ endphering means 72 at a ma 9 netic recordin 9 P° rtion (magnetic stripe or the 

.K^^r ^ apanese Laid "°P en Patent Application No. Hei-06-1 35187 discloses a magnetic card on which a face 
photograph of an owner .s printed on the card in addition to the magnetic data which are originally recorded in the mag- 
netic card and also data of enciphered photographic information are printed. In the technique as disclosed in this pub- 
l.cat.on, the card contains an image region where the outlook information of the owner is displayed, and a scramble 
region where enciphered information obtained by transforming the image information on the basis of a predetermined 
logic is displayed. The enciphered photographic information is decoded by using an inverse logic to verify the identifi- 
cation between the decoded photographic information and the image information of the photograph of the face thereby 
mechanically verifying the justice of the card. (This publication is hereinafter referred to as "second prior art") ' 

• L !j ,dantification cards witn Photographs such as passports, identification cards of employees of companies 
vanous kinds of hcenses. etc. have recently propagated. Further, a credit card to which a photograph is attached has 

Su^Tr^ ' ? eSe 9e ^ era " y Ca,,ed 35 "' D CardS "- Particula "y. a" 'D card with a photograph which is 

ssued by an official organization is used for identification. However, such an ID card may be forged. In fact with respect 
to even present compact passports which are designed to be hardly imitated, there have appeared forged passports 
each of which is obtained by merely replacing a photograph with another in the compact passport. In addition the 
forged passports are designed very elaborately and thus it is very difficult to look through the fake 
«h«7 W ° r ! a T S u are considered as reason wh y forged ID cards containing the forged passports are formed. (1) A 
£ £?T ' D ° an be replaced by another < 2 > is no Nation between the photograph and 

he rtem described on the ID card. In other words, even if only the photograph is replaced by another and the other men- 
tioned items are not changed, it is not identifiable at a glance whether the ID card is true or forged 

i™ lZ° Tde ! t ?,? V ![° 0 ^ e thiS drawback ' tnere are "eeded (a) a method of forming an identification card so that a forg- 

2 M ? S ?• ^ ' S diffiCUltl and (b) 3 meth0d ° f preventin9 use of a forged identification card by checking 

the forgery of the identification card even when the card is forged. 

so tor r?f! r r e J? aneS .i L ^ id ' 0Pen ^ APP" 03110 " Na Hei-3-193495 disclosed an example of the method (a) (hereinaf- 
50 ter referred to as "third prior art"). This publication discloses an ID card issuing system using an image processing 
device taking face photograph information, attribute information, layout information, etc. In this ID card issuing system 
not only the above information, but also forgery preventing information are subjected to image processing to form an 
Sinn fhT',? en 3 ^T 0 ^ Pattem iS su Per P osed on a photograph, and then the overlapped photograph is 
55 fo "ge^ * ' S meth0d> the pMam JO be su PerP°sed on the photograph is complicated to prevent the 

No HP^Tft^r' 6 ° f « he (b) iS diSC ' OSed in 3 f m embodiment of Japanese Laid-open Patent Application 

idLi«n^ ( f re,na ? r t0 38 " f ° Ur,h Pri ° r arr) - ,n this case - dentification data for judging wither an 

.dentrf, cation card .s true or forged are prepared on the basis of data described on the identification card, and the iden- 
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tification data are superposed on the photographic portion of the identification card and printed. According to this 
method, the mentioned items of the identification card and the identification data superposed on the photograph can be 
collated with each other. Therefore, even when the photograph is replaced by another, the forgery can be found out. 
Further, Japanese Laid-open patent Application No. Hei-3-1 85585 discloses a method of embedding the identifica- 

5 tion data into the photograph. The identification data are determined by a calculation based on the mentioned items, 
and the data thus determined are embedded into a part of the photograph. 

From another point of view, if a photograph printed on an ID card is judged to be normal, it can be judged whether 
the ID card is true or forged. Therefore, there has been proposed a method of frequency-transforming an image and 
embedding digital watermark data into frequency spectrum ("Nikkei Electronics" April 22, 1996 (No. 660) p13, "Nikkei 

w Electronics" February 24, 1997 (No. 683) pp99-124) (hereinafter referred to as "fifth prior art"). 

In this method, an original work is frequency-transformed by DCT or Fast Fourier Transform, and the frequency 
spectrum is added with ID information of a random number inherent to each user to thereby spectrum spreading. Since 
the frequency spectrum containing the ID information is subjected to inverse frequency transformation and then the fre- 
quency spectrum having the ID information hidden therein and the frequency spectrum of the original work are differ- 

15 entiated, whereby the ID information is generated. Therefore, comparing the ID information with the normal ID 
information, it can be judged whether this ID conformation is an original work which is legally gained. 

The electronic watermark is embedded into the frequency component while this ID information is set as the fre- 
quency spectrum of the low frequency component, and thus the electrical water mark is not lost even by the image 
processing such as the compression processing, the filtering processing, etc. Further, the random numbers which are 

20 conformed with the normal distribution are used as the electronic watermark to prevent the interference between the 
electronic watermark data, thereby making it difficult to break down the electronic watermark without having a great 
effect on image quality. 

The embedding method of the electronic watermark data is as follows. First, an original image is transformed to fre- 
quency components by using discrete cosine transformation (DCT) or the like, and data of n which indicate high values 
25 in the frequency area are selected as f(1), f(2), ... f(n). 

Subsequently, the electronic watermark data w(1) t w(2). .., w(n) are selected from the normal distribution of 0 in 
average value and 1 in dispersion value, and the following equation is calculated for each frequency component: 

F(i) = f(i) + a|f(i)|*w(i) 

30 

Here, a represents a scaling element. Finally, the frequency component in which f(i) is replaced by F(i) is subjected to 
inverse discrete cosine transformation to obtain an image into which the electronic watermark data are embedded. 

The detection of the electronic watermark data is performed by the following method. In this detection method, the 
original image and electronic watermark data candidates w(i) (i=1, 2, ... n) must be known. 
35 First, an image with electronic watermark data is transformed to frequency components by using DCT or the like. 
Subsequently, the electronic watermark data W(i) is calculated and extracted from f(i) and F(i) by the following equation: 

W(i) = (F(i)-f(i))/f(i). 

40 Subsequently, the statistical similarity of w(i) and W(i) is calculated by using the inner product of vectors: 

C = W * w/(WD * wD) 

Here, W (W(1), W(2), ... W(n)), and w = (w(1) f w(2), .... w(n)), (WD = the absolute value of vector W, and wD = the abso- 
45 lute value of vector w). 

When the statistical similarity C is above a specific value, the electronic watermark data concerned are judged to 
be embedded. 

The electronic watermark is generated from the mentioned items of the ID card, and embedded into a photograph 
to be printed. The electronic watermark is picked up from the photograph at the detection time, and compared with the 
so mentioned items to judge whether the ID card is true or forged. 

In the first prior art, the same magnetic card (a magnetic card which is regarded as being identical) can be prepared 
by merely reading magnetic information on a magnetic card and writing the magnetic information in a magnetic record- 
ing portion on another magnetic card like the magnetic recording portion on the magnetic card concerned. Therefore, 
if a third party directly copies the magnetic information, the same card can be easily prepared. Further, in the conven- 
55 tional magnetic card ID information enciphering system shown in Fig. 20, the ID information on the magnetic card is 
merely recorded as magnetic information, and thus a third party can easily copy the magnetic card concerned. 

Further, in the second prior art in which a photograph 1 isj=tftached on a card, if it is directly copied, the same card 
can be prepared. Further, since data which is correlated wttrVa face photograph is printed, the content of the card can 
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be easily analyzed on the basis of the photograph data of the card. In the second prior art. if a photograph portion or a 
enciphered photograph information portion of the card is greatly scratched, the true card may be judged as a forged 
card. That is. in the such a conventional system that data^obiained by enciphering photograph information are printed 
on a magnetic card, if the print data are directly copied, the same magnetic card can be prepared. Since data correlated 
with a face photograph are printed as "photograph information enciphered data", the content of the ID information (data 
obtained by enciphering photograph information) can be easily analyzed on the basis of the face photograph on the 
magnetic card. 

Further, in the third prior art. since information for preventing forgery can be seen by a person who wants to forge 
the card, the person imitates a complicated pattern superposed thereon to forge the card to the level that an ordinary 
person cannot identify whether it is forged or not. It is possible to forge a forgery-preventing pattern in consideration of 
the present levels of the photograph technique, the image processing technique and the print technique. As a result 
the forged ID cards cannot be identified unless there exists any clear difference in the mentioned items of the ID cards' 

°L e ^ am ? le u there iS S ° me difference in digit from the normal employee number, or the employee number is mentioned 
with Kanji although it must be originally mentioned with numerals. 

In the fourth prior art. identification data which are generated from mentioned items of an ID card are printed while 
superposed on a photograph. According to this method, it can be judged whether the card is true or forged However 
•n this case, the mentioned items and the identification data are visible data, and thus if a sufficient amount of data are 
collected, the calculation equation for generating the identification data from the mentioned items can be guided on the 
basis of both the data by the inverse operation. If this calculation equation is found out. any ID card using the same cal- 
C ^' a !l? n f * ,uat,on as ^ ID rard concerned can be forged unlimitedly. The method of embedding the identification data 
into the photograph is described. However, in this embodiment, the position at which the identification data are embed- 
ded is fixed, so that a forging person can easily specify the position. 

In the fifth prior art using the electronic watermark, an original photograph is required, and there is no possibility 
that the original photograph is held together with an ID card. Accordingly, by only this technique, it is difficult to judge 
whether the holder of the ID card is a legal holder. 

An object of the present invention is to provide a magnetic card ID information enciphering system in which ID infor- 
mation to be recorded/printed on a magnetic card is made both in the form of magnetic information and in the form of 
embedding into a pattern of a magnetic card to prevent a third party from easily copying the magnetic card thereby 
enhancing security on the magnetic card. 

Another object of the present invention is to make it very difficult to forge an ID card by using the electronic water- 
mark technique, and to make it easy to judge whether a holder is a legal holder even when the ID card is forged 

In order to attain the above objects, according to a ciphering/deciphering system for a magnetic card in the present 
invention, there is provided means for easily judging whether an IC card is illegally forged (copied) or not by providing 
means for .nputting information in a pattern of the card in addition to magnetic data so that the card is easily judged to 
be copied when a third party illegally copies the magnetic data of the card. 

More specifically, a fingerprint pattern of an owner on the basis of which a pattern of an ID card is created is sub- 
jected to FFT (Fast Fourier Transform) to transform the fingerprint pattern to frequency-domain information, the ID infor- 
mat.on is added to a frequency component having strong energy on the basis of the frequency-domain information thus 
generated, the addition result is subjected to inverse FFT (Fast Fourier Transform) processing to transform the fre- 
quency-domain information to a two-dimensional image, and then the fingerprint pattern in which the ID information is 
embedded is printed on the card. 

In an identification process of the ID card thus generated, the fingerprint pattern of the card is read by a reader to 
transform the read image to the frequency-domain information by the FFT processing. Thereafter, the fingerprint of the 
holder is read by the reader to transform the read data to frequency-domain information by the FFT processing Both 
the results of the frequency-domain information are differentiated to extract ID information. 

Further, data which are read by a magnetic card reader are decoded and deciphered to extract ID information as 
is usually performed. The ID information thus extracted and the ID information extracted from the card pattern are com- 
pared with each other. If the ID information is identical, the ID card is judged as an original card. On the other hand if 
the ID information is different, the ID card is judged as a illegally copied card. 

In addition to ordinary magnetic information. ID information is inserted into the pattern of the card on the magnetic 
card. Therefore, even when the magnetic data are copied, the card is not identified as the original card unless the pat- 
tern portion is copied. By comparing the ID information extracted from the pattern of the card and the ID information 
extracted from the magnetic data, an illegal copy of the card can be easily found out. Further, the insertion of the ID 
information into the pattern means that the ID information is printed in an area containing frequency components having 
strong energy on the pattern, so that a nonprofessional cannot find it. Even if the difference in pattern is found out it is 
impossible to extract the ID information unless there is the fingerprint patter of a legal holder. 

Further, a magnetic card ID information enciphering system according to the present invention which includes enci- 
phering means for enciphering ID information of a magnetic card and magnetic information creating means for record- 
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ing the enciphered ID information as magnetic information in the magnetic card, is characterized by further including 
frequency-domain transformation means for transforming an original image pattern of a magnetic card to frequency 
(spatial frequency) domain information, adding means for generating information in which the ID information of the mag- 
netic card is distributed on the frequency domain, and adding the information thus generated and the information which 

5 is generated by the conversion of the frequency-domain transformation means, frequency-domain inverse transforma- 
tion means for restoring the information of the frequency domain generated by the addition of the adding means to a 
two-dimensional image pattern, and image pattern print means for printing the image pattern generated by the fre- 
quency-domain inverse transformation means on the magnetic card so that the image pattern is used as a pattern of 
the magnetic card. Here, the frequency-domain transform means is implemented by FFT (Fast Fourier Transform) 

10 means, DCT (Discrete Cosine Transform) means or the like, and the frequency-domain inverse transformation means 
is implemented by inverse FFT means, inverse DCT means or the like. 

Still further, according to a card type recording medium of the present invention, a photograph to be printed on a 
card is taken as digital data, and the digital data thus taken are subjected to DCT transformation to be transformed to 
spatial frequency, and the identification data generated from the items mentioned on the card are inserted into the data 

is after the transformation. When the card is used as an ID card, the data inserted in the ID card are subjected to 
IDCT(lnverse DCT) transformation to be restored to a normal photograph, and it is printed on the ID card together with 
the data described on the ID card. When checking the ID card, the photograph and the mentioned items of the ID card 
are read in, and the data of the read-in photograph are subjected to DCT to be transformed to spatial frequency. Fur- 
ther, identification (ID) data are generated from the read-in description matte, and it is judged on the basis of the corre- 

20 lation between the spatial frequency and the ID data whether the ID card is true or forged. 

With the above construction, when the correlation between the photograph of the ID card and the identification data 
is high, the ID card is judged to be true. Further, when the correlation is low, the ID card concerned is judged to be 
forged. 

Further, the present invention is directed to a recording medium in which a program for operating a card type 
25 recording medium forming system in a computer is recorded. The program includes a step of generating identification 
data on the basis of specific data for specifying an owner, a step of transforming a photograph image to be attached to 
spatial frequency data, a step of multiplying each component of the spatial frequency data with the component corre- 
sponding to the identification data, adding the value obtained by multiplying the above multiplication value and a con- 
stant to the component corresponding to the spatial frequency data of the photograph image, and inversely 
30 transforming the added spatial frequency data to image data, and a step for writing the image data and the specific data 
on the card type recording medium. Data to be respectively written in an image area where image data are written every 
step and a data area where ID information and specific data are written are created, so that the manufacturing of the 
recording media can be facilitated and uniform cards having no error can be manufactured. 

Fig. 1 is a block diagram showing judgment means for a card type recording medium of the present invention; 
Fig. 2 is a flow of creating a card according to an embodiment of the present invention; 
Fig. 3 is a diagram showing the card of the embodiment of the present invention; 
Fig. 4 is a diagram showing the principle of the present invention; 

Fig. 5 is a diagram showing extraction of an ID information of the embodiment of the present invention; 
Fig. 6 is a block diagram showing a first embodiment; 

Fig. 7 is a block diagram showing the construction of the first embodiment of a magnetic card ID information enci- 
phering system according to the present invention; 

Fig. 8 is a diagram showing the principle of the magnetic card ID information enciphering system shown in Fig. 7; 
Fig. 9 is a diagram showing the processing (ID information dividing processing, etc.) by adding means of Fig. 7; 
Fig. 10 is a diagram showing an example of a magnetic card which is manufactured by a magnetic card ID informa- 
tion enciphering system shown in fig. 7; 

Fig. 1 1 is a flowchart showing the processing of the magnetic card ID information enciphering system shown in Fig. 
7; 

Fig. 1 2 is a block diagram showing the construction of a fifth embodiment of the magnetic card ID information enci- 
phering system of the present invention; 

Fig. 1 3 is a block diagram showing the construction of the fifth embodiment of a magnetic card ID information enci- 
phering decoder of the present invention; 

Fig. 14 is a diagram showing the flow of forming an ID card according to a sixth embodiment of the present inven- 
tion; 

Fig. 15 is a flowchart showing an ID card checking processing of the sixth embodiment of the present invention; 
Figs. 16A and 16B are diagrams showing the construction of an ID card forming system and an ID card checking 
system of the sixth embodiment of the present invention selectively; 

Fig. 17 is a flowchart showing the ID card forming processing of a seventh embodiment of the present invention; 
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Fig. 18 is a flowchart showing the ID card checking processing of the seventh embodiment of the present invention- 
Figs 19A and 19B are diagrams showing the construction of an ID card forming system and an ID card checking 
system of the seventh embodiment of the present inveVitfon Respectively; and 

Fig 20 is a block diagram showing the construction of a conventional magnetic card ID information enciphering 
sysi6m. 

»™!in red ! ) mb0dimentS accordin 9 10 the P^ent invention will be described hereunder with reference to the 
accompanying drawings. 

[First Embodiment] 

A first embodiment according to the present invention will be described 

As shown in Fig 1 . a fingerprint pattern printed on a card 25 is read out by a card image reader 6. and the image 

LsTr-d bv S a U ? 6Cted t0 , Fa *1 F0Urief J ranSf ° rm by FFT ? - Furth6r - 3 finger P rint pattern of 3 n°'der <* theTard 

25 ,s read by a fingerprint pattern reader 1 0 and the data thus read are subjected to Fast Fourier Transform by FFT 1 1 

fhe ^rfefof 2£S ° f *" 1 1 ,r ° m 0UtPUt ° f thS FFT 7 10 6XtraCt ,D information 9 Specifies 

tion a"* 8 '' ma9n6tiC ^ ^ ° ard 25 alS ° read and deCOded by decodin 9 Processing 2 to extract ID informa- 

The ID information 9 extracted from the pattern of the card 25 and the ID information 3 extracted from the magnetic 

2u,i ZSS T^£ ch TT a ro :r rator 4> and a jud9ment drcurt 5 jud9es rt on *• basis of 

result whether the card 25 is illegally copied or not. 

Next, the method of forming the card 25 will be described. 

mJS S^Z "Li t 3 ' ll!IS!T rint u Pattern 19 and 3 ma9netic Stripe 18 are formed on *e ««d 25. Further, ID infor- 

ss^^ss^^ pattem of the card 2s - ™ e method ° f embeddin9 ,he id ™ 

an i™ F ' 9 ' 2 ' I* 16 /'"? 6 ^ , Pattem ° f the h0 ' der to 66 printed on the 25 is read as a fingerprint image signal by 
ELSE! ^ I ^ and SUbi6Cted 10 FaSt F ° Urier TranSform in FFT 11 50 that 106 «ngerprint image signal is 

L™LT^ ° eqU6 ? Cy d0 !H*?; Tnereafter - the 10 information 9 is added to a frequency band containing frequency 
components having strong (high) energy by an adder 13. In this case, the ID information which is minute (weak in 
1 t0 th6 b3nd havi " 9 106 stron 9-energy frequency components, and thus it has little effect on the original 

he n ^Sf qU ?" tly ' *V e addi,i0n resu,t is transformed to a two<Jimensional image by inverse FFT 14 to form a pattern to 
be printed on the card 25. and a fingerprint pattern as indicated by reference numeral 19 in Fig. 3 is printed on the card 
25 by a fingerprint pattern printer 15. Here, the printed fingerprint pattern 19 cannot be visually discriminated from the 

Serem * " ^ ** P "" n ^ " ke *" ° ri9inal ^ even ^^TXm^ 

Further the ID information 9 is enciphered by an encipherer, and magnetic information is generated on the maq- 
netic stnpe (18 of F,g. 3) of the card by a magnetic tape forming machine 17. At this time, any one of the writing st3 

Lrfo 'tn 9 . e hT r ^ Pa ? m l* ^ th t Writin9 St6p ° f magnetiC informa «°n on the magnetic stripe may be performed 
prior to the other step, however, these steps must be matched integrally 

th. m!nn2 in9 H^ ^J?!^ m8thod ' ^ formed a «"* in which ,he ,D information of the card is printed in both 

the magnetic data and the pattern of the fingerprint pattern. 

roaH ^ rnin iH 9 t to Fig - J the 030:1 25 wnich is form ed according to the above method is read by the fingerprint pattern 
ZSZL JF ** ,m c 9e ,S c Subjected to Fast Fourier Tra ^form by the FFT 7 to be transformed to frequency- 
suZn 2E!2! H&re ^ & f Fa r s ' Transform is a Fo ^r Transform of a discrete numeral sequence, and it has 

form Bv STTvl - x T " be mor0 9reat,y redUC6d 38 C0mp3red with the 9 eneral F °^r Trans- 

e47eJ 5 k"" 6 ' * 3nsform - the ,rec » uenc y Wum of (fingerprint pattern + ID information) is gen- 

fTnSr nt » P ?f !T1 L" J 10 "" ( " ke ,in 9 er P rin t data + ID information 20) in Fig. 4. Subsequently the 

SoniTnTn SS? » » » 'Y^ * 1,19 ,in9erprint r63der 10 is ,ikew * e transformed to frequency 

4 SSL n li? S . f" 3 ,,n9erpr,nt data fre « uenc y 8P«*«" 22 as indicated by reference numeral 22of Fig 

!'.mnf™S °f ' Pr i frequancy ? ectrum 22 is subtracted from the frequency spectrum 20 of (fingerprint pattern 
f D fnfoSon " y th6 ' D information is «««« a * shown in the frequency spectrum 21 of the 

inf Q r F ^r a «^ m ^ n ^ d !!i a T th ! Card 25 are read out by the ^ magnetic reader 1 and the coded data of the 
nfo mation are decoded by the decoding processing 2 to extract the ID information 3. In the card magnetic reader 1 
the fnger pattern ,n the card 25 and the magnetic information of the magnetic strip in the card 25 are rSd «ZS£ 
neously or wrth a tme .ag by photoelectric transducing means of an optica, head and a magnetic/electrS SansTc ng 
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means of a magnetic head respectively while the card and each of the heads are relatively moved. 

Subsequently, the ID information extracted from the pattern of the fingerprint pattern of the card 25 and the ID infor- 
mation 3 extracted from the magnetic data of the card are compared by a comparator 4. If they are the same ID infor- 
mation, the judgment circuit 5 judges that the card is a normal (legal) card. If they are different from each other, the 
5 judgment circuit 5 judges that the card is illegally copied. 

The above processing may be implemented by a computer having programs stored therein, or the like. That is. the 
program for executing the above processing is stored on a recording medium such as a floppy disc or the like, and the 
computer loads the program from the storing medium to execute the program. 

Further, in the above embodiment, the fingerprint pattern and the ID information are written in the card type record- 
10 ing medium. A face photograph or information having some characteristic such as the retina of eyes and the ID infor- 
mation may treated as a pair to judge whether the holder of the card type recording medium is judged to be a right 
holder. Accordingly the forgery of the card type recording medium can be prevented, and this embodiment is effective 
as a countermeasure against imitations. 

In the above embodiment, the ID information is recorded on the magnetic stripe. However, the IC card may be used 
is in place of the magnetic card, and for example the ID information may be stored into EEPROM, a flash memory or the 
like to apply the above operation as described above. Further, the same is applied to another card type recording 
medium. It is needless to say that the above point is applied at a suitable time in the following embodiments. 

[Second Embodiment] 

20 

Next, a second embodiment will be described with reference to the accompanying drawings. 

This embodiment will be described in detail and specifically according to the first embodiment. 

Referring to Fig. 1 , the fingerprint pattern 1 9 of the card 25 is read in by the card image reader 6. FFT 7 and FFT 
1 1 are Fast Fourier Transform for dividing to frequency bands of 25 points. The quantization number per frequency band 
25 is set to 16 bits. In the Subtracter 8, the fingerprint pattern of the holder which is read by the fingerprint reader 10 and 
then subjected to Fast Fourier Transform in FFT 1 1 is subtracted from the fingerprint pattern 19 which is read from the 
card in FFT 7 and then subjected to Fast Fourier Transform, thereby extracting the ID information 9 of 32 bits for spec- 
ifying the user 

Further, the magnetic data 18 of the card 25 are read by the card magnetic reader 1 , and the data thus read are 

30 decoded by the decoding 2 to extract the ID information 3 of 32 bits. 

The ID information 9 of 32 bits which is extracted from the pattern of the fingerprint pattern 19 of the card 25. and 
the ID information 3 of 32 bits which is extracted from the magnetic data 18 are compared with each other by the com- 
parator 4. If the ID information 9 and the ID information 3 are identical to each other, the comparator 4 outputs "0". If 
they are different from each other, the comparator 4 output "1". When "0" is output, the judgment circuit 5 judges that 

35 the ID card is a normal (legal) card. When M r is output, it judges that the ID card is an illegally copied card. 

First. ID information of 32 bits is beforehand embedded in the pattern of the fingerprint pattern 19 of the card 25. 
The method of embedding the ID information will be described in detail with reference to Fig. 2. 

The fingerprint pattern 12 of the holder to be printed on the card is transformed to frequency domain by FFT 1 1 , 
and the ID information 9 of 32 bits is added to a band having strong frequencies by the adder 12. FFT 11 is the Fast 

40 Fourier Transform for dividing into frequency bands of 25 points, and the quantization number per frequency band is 
equal to 16 bits. In this case, since minute ID information is added to an area having strong energy, it has little effect on 
the fingerprint pattern of the holder. According to the method in this case, the ID information of 32 bits is divided into 4 
bits x 3, 3 bits x 4 and 2 bits x 4, and successively added from a frequency band containing the frequency component 
of stronger energy. Subsequently, the result is transformed to a two-dimensional image by the inverse FFT 14 to form 

45 a pattern to be printed on the card, and a fingerprint pattern is printed on the card by the fingerprint pattern printer 15. 
The image thus printed is finished as being undiscriminable from the fingerprint pattern 12 of the holder itself, and thus 
the pattern looks like the original one even if the ID information is different. 

Further, the ID information 9 of 32 bits is enciphered by the encipherer 16, and the magnetic information is formed 
on the card 25 by the magnetic tape forming machine 17.. 

so By the above method is formed a card in which the ID information 9 of 32 bits is printed in both the magnetic data 
1 8 and the pattern of the fingerprint pattern 1 9 of the card. 

The fingerprint pattern 19 of the card 25 generated by the above method is first read by the fingerprint pattern 
reader 6 to transform the image to the frequency domain information by FFT 7 to obtain a frequency spectrum 20 of 
(fingerprint pattern + ID information). Subsequently, as shown in Fig. 4, the fingerprint pattern 12 of the holder itself is 

55 transformed to the frequency domain by FFT 1 1 to obtain a fingerprint data frequency spectrum 22. Further, the finger- 
print data frequency spectrum 22 is subtracted from the frequency spectrum 20 of (fingerprint pattern + ID information) 
by the subtracter 8, whereby only a portion of ID information ^\\s extracted at a portion having strong frequency com- 
ponents as shown in Fig. 5. The spectrum comprising only the' ^information 21 is divided into 4 bits x 3, 3 bits x 4 and 
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2 bits x 4, for example, and the data thereof are rearranged in the reverse orderto the order when the ID information is 
beforehand written on the card, thereby returning the data to the ID information of 32 bits. 

Further, as shown in Fig. 1, the magnetic data are readout by the magnetic reader 1 for the card to decode the 
codes of the information by the decoding processing 2 and extract the ID information 3 of 32 bits 
„ j^ bse ? uently ' tne 32 - bit ID information 9 extracted from the fingerprint pattern of the card 25 is compared with the 
32-bit ID informat.on 3 extracted form the magnetic data of the card in the comparator 4. If they are the same ID infor- 
mation, the comparator 4 outputs "0". If they are different from each other, the comparator 4 outputs "1 " If the output of 
the comparator 4 is "0". the judgment circuit 5 judges that the ID card is a normal (legal) card, and thus it shifts the proc- 
ess to subsequent ordinary card processing. If the output is "1 ". the judgment circuit judges that the ID card is an ille- 
gally copied card, and thus it ceases the card processing. 

[Third Embodiment] 

drawUS' th€> 6mbodiment accordin 3 to » h e present invention will be described with reference to the accompanying 

Referring to Fig. 6, the principle of the third embodiment is basically identical to that of Fig. 1. DCT (discrete cosine 
transformation) used for image compression such as JPEG or the like is applied to the portion corresponding to FFT 
DCT is one type of orthogonal transformation encoding processing, and it is an improved version of DFT (Discrete Fou- 
rier Transform). That .s. image data are transformed with an orthogonal transformation matrix every block comprising 8 
pixels x 8 pixels and the transformation result is quantized and replaced by encoded data to encode the image data 
As m the case of FFT. the processing speed of DCT can be increased by a butterfly operation, and it uses the charac- 
teristic of image components in which the amount of frequency components is small. Any one of the equi-length encod- 
ing system based on non-linear quantization and the length-variable encoding system based on quasi-linear 
quantization The DCT of this embodiment has the following advantage. That is. if an encoding error is varied in accord- 
ance with a block to be image-compressed, the block appears as a block distortion on a screen. Therefore in the case 
o a screen in which the block distortion is remarkable, the encoding speed is increased. On the other hand in the case 
of a screen in which the block distortion is not remarkable, the encoding speed is reduced, whereby the image quality 
is uniform as a whole. H 1 

In the transforming operation of the DCTs 23, 24. according to the first embodiment, the transformation of the fre- 
quency domain is performed for all the information of the fingerprint pattern. However, according to the second embod- 
iment, the f ingerpnnt pattern of the holder itself is beforehand divided into minute images (blocks) of 8x8 dots when the 
pattern of the card is formed, and printed on the card by using DCT. In this case, the ID information 9 is printed in all 
the ar^s into which the fingerprint pattern is minutely divided by 8x8 dots. Therefore, even when the card is scratched 
or the fingerprint of the holder itself is slightly damaged, the ID information can be extracted due to the correlation of 
the data in non-scratched portions by majority voting if the scratch or damage is limited to some degree 

Further, in the above embodiment, the ID information is added to the specific frequency component of the fre- 
quency spectrum of the image signal which is obtained from the fingerprint pattern by FFT or DCT. In this case by spec- 
ifying a characteristic area and a range of the fingerprint pattern, a fingerprint pattern gaining area and a range thereof 
at the actual fingerprint pickup time must be matched with them. However, this point can be solved by conforming them 
to the pickup characteristic of the fingerprint reader 1 0. 

[fourth Embodiment] 

The fourth embodiment of the present invention relates to a magnetic card ID information enciphering system and 
a magnetic card is used as a card type recording medium. 

Fig 7 is a block diagram showing the construction of the magnetic carcl ID information enciphering system The 
magnetic card ID information enciphering system of this embodiment includes FFT means 32 for performing FFT (Fast 
Fourier Transform) on an original image pattern 31 which is an origin of a pattern to be printed on a magnetic card to 
transform the original image pattern 31 to frequency domain information (original image frequency spectrum 39 see 
Pig. 8), adding means 33 for generating information (ID information frequency spectrum 41. see Fig. 8) in which the ID 
information 36 specifying the user of the magnetic card is distributed on the frequency domain, and adding the original 
-mage frequency spectrum 39 and the ID information frequency spectrum 41 . inverse FFT means 34 for restoring to the 
too-d,mens,onal image pattern the frequency spectrum 40 (see Fig. 8) of (original image + ID information) serving as 
lwn " ' ' nf ° rm *fon generated by the addition of the adding means 33. image pattern print means 35 for 
1 ' m ! 9e P ^! m 9enerated by * e inverse FFT means 34 on the magnetic card so that the image pattern is 
used as ; ttie pattern of the magnetic card (see Fig. 10). enciphering means 37 for enciphering the content of the ID infor- 
mation 36 (no limitation is imposed on the enciphering manner), and magnetic information creating means 38 for writing 
the enciphered ID information 36 as the magnetic information in a magnetic recording portion such as a magnetic stripe 
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(see Fig. 10) on the magnetic card. 

Here, as the enciphering mode of the enciphering means 37 may be used a stream encipherment of a synchronous 
type or the like such as a block encipherment of DES, MULT12 or the like, a Vernam encipherment, an interchange enci- 
pherment or the like, a power surplus type encipher such as R AS, Rabin or the like based on an asymmetrical encipher 
5 system (open key encipherment), a knapsack type encipherment or the like. That is, it is not limited unless the use 
thereof is limited. 

The constituent elements in Fig. 7 will be additionally described. The FFT means 32 performs FFT for division into 
the frequency bands of 25 points. Here, the quantization number per frequency band is set to 16 bits, for example. The 
enciphering means 37 enciphers the ID information 36 of 32 bits, for example (see Fig. 9). 
io The enciphering means 37 and the magnetic information forming means 38 may be the means having the same 
name (see Fig. 20) and the same means as described in the first prior art. 

Fig. 8 shows the principle of the magnetic card ID information enciphering system of this embodiment. Fig. 9 is a 
diagram showing the processing of the adding means 33 (the division processing of the ID information 36, etc.). 

Further, Fig. 10 shows an example of a magnetic card 42 which is manufactured by the magnetic card ID informa- 
15 tion enciphering system of this embodiment. The magnetic card 42 includes a pattern 44 into which ID information is 
printed, and a magnetic stripe 43 containing data obtained by enciphering the ID information. The holder of the mag- 
netic card 42 individually or collectively holds and suggests an ID card certifying the holder itself, a cash card for a bank, 
a credit card or the like, where the holder is allowed to use the magnetic card 42 variously. 

Fig. 11 is a flowchart showing the magnetic card ID information enciphering system of this embodiment This 
20 processing comprises a FFT step 501 , an ID information frequency spectrum generating step 502, a (original image + 
ID information) frequency spectrum generating step 503, an inverse FFT step 504, an image pattern print step 505 an 
enciphering step 506, and a magnetic information recording step 507. 

Next, the operation of the magnetic card ID information enciphering system of this embodiment thus constructed 
will be described in detail with reference to Figs. 7 to 1 1. 
25 First, an original image pattern 31 serving as an origin to a pattern to be printed on the magnetic card is prepared. 
At this time, as the original image pattern 31 is beforehand prepared such a pattern that when it is afterwards trans- 
formed to frequency domain information, no overflow occurs irrespective of addition of the ID information 36 to the pat- 
tern. 

The FFT means 32 performs the Fast Fourier Transform (FFT) on the original image pattern 31 so as to transform 

30 the original image pattern 31 to the frequency domain information (step 501 of Fig. 11), whereby the original image pat- 
tern 31 is transformed to an original image frequency spectrum 39 as shown in Fig. 8. 

Upon viewing the distribution condition of the original image frequency 39 generated by the FFT means 32, the 
adding means 33 generates an ID information frequency spectrum 41 as shown in Figs. 8 and 9 (step 502). That is, 
when the ID information 36 is composed of 32 bits like this embodiment, the 32 bits are divided into 4 bits x 3, 3 bits x 

35 4 and 2 bits x 4 so that the distribution of 32 bits is made similar to the distribution condition of the original image fre- 
quency spectrum 39. thereby generating an ID information frequency spectrum 41. That is, the 32 bits are distributed 
(divided) so that a portion having a higher number of bits is preferentially distributed (allocated) to a frequency compo- 
nent portion having stronger energy of the original image pattern 31 , and this operation is successively repeated until 
a portion having the lowest number of bits is distributed (allocated) to a frequency component portion having the weak- 

40 est energy of the original image pattern 31 , whereby the ID information frequency spectrum 41 is generated. However, 
it is needless to say that this embodiment can be implemented even when the above "the processing of establishing 
similarity between the distribution condition of the original image frequency spectrum 39 and the distribution condition 
of the ID information frequency spectrum 41" is not performed. 

Subsequently, the adding means 33 adds the original image frequency spectrum 39 and the ID information fre- 

45 quency spectrum 41 as shown in Fig. 8 to generate (original image + ID information) frequency spectrum 40 (step 503). 
In this case, the energy of the ID information frequency spectrum 41 is set to be more minute as compared with the 
energy of the original image frequency spectrum 39, and thus the existence of the ID information 36 (ID information fre- 
quency spectrum 41) has little effect on the image pattern serving as the pattern on the magnetic card. Further, in this 
embodiment, the distribution condition of the original image frequency spectrum 39 and the distribution condition of the 

so ID information frequency spectrum 41 are set to be similar as much as possible in shape (see Fig. 8), so that the effect 
of the ID information 36 on the image pattern of the magnetic card is further reduced. 

The inverse FFT means 34 performs the inverse FFT on the (original image + ID information) frequency spectrum 
40 generated in step 503 t restore the (original image + ID information) frequency spectrum 40 to an image pattern 
(step 504). The image pattern thus generated is visually undiscriminable from the original image pattern 31 . 

55 The image pattern print means 35 prints the image pattern as a pattern on the magnetic card (step 505). The pat- 
ters on the magnetic cards thus formed (printed) look perfectly like each other irrespective of the difference in ID infor- 
mation 36 if the original image patterns 31 thereof are idertticaktfl each other. 

Further, the enciphering means 37 enciphers the data ofthe ID information 36 so that it is difficult to analyze the 
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data in the same manner as the conventional technique of recording the magnetic information on the magnetic card 
(step 506). 

The magnetic information forming means 38 writes the piagnetic information representing the ID information enci- 
phered in step 506 into the magnetic recording portion (the magnetic stripe in Fig. 10) (step 507) With the above oper- 
ation, the ID information 36 of the magnetic card is recorded/printed (stenciled) both in the format of the magnetic 
information and in the format of the pattern. a 

In the above embodiment, the ID information is added to the original image pattern on the magnetic card (recording 
medium) so that the image signal on the magnetic card which is apparently viewed is set to be visually undiscriminable 
from the original .mage pattern; However, the ID information can be read out from the enciphered magnetic card by a 
specific decoder, and on the basis of the judgment as whether the ID information thus read is coincident with the ID 
information indicated by the actual holder of the magnetic card, it is judged whether the holder is an legal holder or an 
illegal holder. 

[Fifth Embodiment] 

The magnetic card ID information enciphering system of the fifth embodiment will be described 

Fig. 12 is a block diagram showing the construction of the fifth embodiment of the magnetic card ID information 
enciphering system according to the present invention. The magnetic card ID information enciphering system of this 
embodiment includes DCT means 62 for transforming the original image pattern 61 serving as the origin to a pattern to 
SfS * °?n he , mag ". etic to ^equency domain information by DCT. adding means 63 for generating information 
in which the ID information 66 specifying the user of the magnetic card is distributed on the frequency domain and add- 
ing the information thus generated to the frequency domain information generated by the DCT means 62 inverse DCT 
means 6 for restoring the frequency domain information added by the adding means 63 to a twoKJimensional image 
pattern by inverse DCT. image pattern print means 65 for printing the image pattern generated by the inverse DCT 
means 64 on the magnetic card so that it is used as a pattern on the magnetic card , enciphering means 67 for enci- 
phering the content of the ID information 66 (no limitation is imposed on the enciphering way), and magnetic information 
forming means 68 for writing the enciphered ID information 66 as magnetic information at a magnetic recording portion 
such as a magnetic stripe or the like on the magnetic card. 

The adding means 63. the image pattern print means 65. the enciphering means 67 and the magnetic information 
forming means 68 of this embodiment are similar to the adding means 33. the image pattern print means 35. the enci- 
phering means 37 and the magnetic information forming means 38 of the fourth embodiment respectively 

As shown in Fig. 12, the principle of the magnetic card ID information enciphering system of this embodiment is 
basically idenbcal to that of the fourth embodiment shown in Fig. 8. However, in this embodiment. DCT means 62 which 
performs DCT DCT on the condition that the original image pattern 61 is fragmented into fragmented original image 
patterns) used for image compression such as JPEG (Joint Photographic Coding Experts Group) or the like is used for 
the portion corresponding to the FFT means 32 in Fig. 7. and inverse DCT means 64 is used for the portion correspond- 
mg to the inverse FFT means 34. 

Next, the characteristic feature of this embodiment will be descried. 

In the fourth embodiment, the FFT means 32 performs the conversion to frequency domain information while all the 
.nformat.on of the original image pattern is targeted. However, the DCT means 62 of the second embodiment divides 
the original .mage pattern into fragmented original patterns (fine image patterns of 8x 8 dots), and then DCT is per- 
formed on each fragmented original image pattern. 

™ ♦ FUr lc er ^ e f di " 9 meanS 63 distributes »» ID information 66 on the frequency domain and then adds the ID infor- 
mation 66 of the frequency domain to each information obtained by subjecting each fragmented original image pattern 

In the magnetic card ID information enciphering system of this embodiment, the ID information 66 is printed into all 
the fragmented original image patterns as descried above. Therefore, even when the magnetic card is partially 

wS aS not ^rSed the im39e ^ ^ ^ '° information 66 is sti " P rinted at Prions 

A decoding system for the magnetic card ID information enciphering system will be described with reference to Fig 
13. The card type recording medium 42 which contains the image data of the pattern 44 having the accurate ID infor- 
iT^= n ^ P l ma 9 netic stri P e 43 on whi <* the ID information is recorded as an enciphered code 

s inserted into a predeterm.ned position of the magnetic card information decoder. In the magnetic reader 81 the 
^?"^cord w h ,ch IS recorded on the magnetic stripe 43 is transformed to electrical signals by a magnetic head 
y ? I? 9 " 6 * 0 Card 42 - tersely-enciphering means 82. the enciphered recording code is 
mp a £ If ,nformation donal in the opposite system to the enciphering system of the enciphering 

means 67 to obtain ID mformafon 83. On the other hand, in an image reader 84. the area of a predetermined pattern 
44 is read out as an image signal by a photoelectric transducing element directly or while scaled down. The image sig- 
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nal is subjected to DCT every sub block by the DCT means as in the case of the DCT means 62. Subsequently, the 
frequency spectrum data of the ID information 83 is subtracted from the image signal which has been subjected to DCT, 
and the transformation which is opposite to that of the DCT means 85 is performed on the subtraction result in the 
inverse DCT means 87 to obtain an extraction pattern 88. 

Subsequently, the face of a holder who holds the card type recording medium is obtained by a photographing oper- 
ation or the like, or the original image of a copyrighted work itself is digitally transformed as an original image pattern 
89. and compared with the digital signal of the extracted pattern by a comparator 90. As a result, if it is judged that there 
is no difference therebetween and thus they are the same pattern, the holder is certified as a legal card holder. On the 
other hand, when the difference between them is large, the holder is judged to be an illegal card holder. 

In this case, if the detected ID information 83 and the ID information indicated by the holder of the magnetic card 
are coincident with each other, the holder of the original pattern concerned is judged to be coincident. !f not so, it is 
judged that the holder of the magnetic card picks up the magnetic card or has a dishonest act. When the original image 
pattern itself is a valuable copyrighted work, it can be immediately judged whether the holder of the magnetic card is a 
true holder or not if the original image pattern is printed on the magnetic card as described above. Therefore, the forgery 
and illegal use of the magnetic card are found out, and thus the security can be enhanced. 

In the above embodiment, the decoder is designed to support the magnetic ID information enciphering system 
shown in Fig. 12. However, the magnetic card ID information enciphering system of the fourth embodiment may be con- 
structed to perform the above decoding operation by changing the DCT means 85 and the inverse DCT means 87 to 
the FFT means 32 and the inverse FFT means 34. 

[Sixth Embodiment] 

Fig. 14 is a block diagram showing formation of an ID card which is one type of card type recording medium of the 
sixth embodiment of the present invention together with a signal flow. Fig. 15 is a block diagram showing a checking 
process for checking the ID card of the sixth embodiment Fig. 16 shows a system for issuing the ID card of the sixth 
embodiment, and Fig. 17 shows a system for checking the ID card of the sixth embodiment. 

In Fig. 14, reference numeral 100 represents a photograph of the norma! (true) holder of an ID card. Reference 
numeral 110 represents items which are mentioned on the ID card 220. The name of the holder, the name of the 
holder's post, the registration number and the employee number are mentioned on the ID card 220 when the ID card is 
an ID card for a public servant or a company employee. When the ID card is an ID card for a student, the name of the 
holder, the name of the holder's faculty, the student number, etc. are mentioned on the card. Reference numeral 120 
represents a capture for reading the photograph 100 as image data. Reference numeral 130 represents an identifica- 
tion data generator for generating identification data on the basis of the mentioned items 1 10 of the ID card 220 by a 
calculation. The identification data may be generated by generating a random number on the basis of the name and the 
employee number. Reference numeral 140 represents a DCT unit having a function of transforming the image data 
taken by the capture 120 to spatial frequency components. Reference numeral 150 represents a partial average calcu- 
lator 150 for calculating the average value of the absolute values at three near points of the spatial frequency compo- 
nents. This partial average is multiplied with the identification data in a multiplier 160, and the multiplication result is 
multiplied by a constant a in a multiplier 180. The output of the multiplier 180 is added to the output of the DCT unit 140 
in an adder 1 90, and the addition result is supplied to an IDCT (Inverse Discrete Cosine Transform) unit 200. The con- 
stant a is a scaling factor. Reference numeral 200 represents an IDCT unit having a function of transforming the spatial 
frequencies to image data which can be seen by humans. Reference numeral 210 represents a photograph in which 
the identification data are embedded, and the photograph 210 and the mentioned items 1 10 are printed on the ID card 
220. 

Next, the certifying/checking means when the ID card thus formed is actually used will be described. 

In Fig. 15. on an ID card 300 are printed a photograph embedded with identification data, and mentioned items on 
which the identification data are generated. The capture 310 photoelectrical^ transforms and reads the image portion 
of the photograph of the ID card to separate the photographic image and the mentioned-item portion as image data. A 
DCT unit 320 has a function of transforming the image data separated in the capture 310 to spatial frequency compo- 
nents. A character recognizer 330 transforms the image data of the mentioned-item portion separated in the capture 
310 to characters by the character recognition. A partial average calculator 340 calculates the average value of the 
absolute values at three neighboring points of the spatial frequency components. 

An identification data generator 370 calculates the identification data on the basis of the mentioned-item data sep- 
arated from the capture 310. An inner product calculator 380 has a function of calculating the inner product between 
the identification data extracted from the spatial frequencies of the image and the identification data generated from the 
mentioned items. The operation of a divider 350 and an adder 360 will be described later. 

The ID card forming operation and the ID card checkinfg operation will be described hereunder in more detail. 

First, the ID card forming operation will be described. ' • 
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who " eeds an ID «>* Prepares a photograph 100 and mentioned items required to form identification 
data In this case the mentioned rtems are set to the employee number. A person in charge of ID card formation picks 
up the photograph into an image processing device 830 by aicamera 800 or a scanner 810 as shown in Fig 16A 

««„ F -£ ther ' rt T S 1 10 are input throush a ^toatd 820 by the person in charge of the ID card forma- 
ionJ^lTSf ? n P hoto 9 ra P h 1 1 ° «hich is picked up into the image processing device 830 and the men- 
oned-rtem data 110 are processed along the flow of Fig; 14. The pickup image data are transformed to spatial 

SZ^n h° n H?H m 6 DCT Unit 1 4 °- the idenWication data ^nerator 130. identification data having a normal 
h 7 h H 6 aVera9e , ? 8qUal l ° 2er ° 3nd ,he diSpersi ° n is equal to 1 are aenerated ° n the basis of the men- 

fenSaTn^H^ H 6 K nPUt ?°" T keyb0afd 82 °- ThS follOWin9 Ca ' CU,ation is P erform ^ bet ^" the identifica- 

Ss^™ t0 ^ freqU6nCy C ° mPOnente 40 6mbed the idenWiC3ti0n da ' a ^ 

frequ'^ 

f(1). f(2). ... f(n) 
and the identification data are represented as follows: 

w(1). w(2). .., w(n) 

The following equation is calculated for each i: 

F(i)=f(i) + axavg(f(i))xw(i) 

The partial average avg(f(i)) is calculated in the partial average calculator 150 as described above 

,. ™ ,D 5 T u " rt 200 subjects *» calculation result to inverse cosine transformation to prepare a photograph 210 in 
which the identrficaton data are embedded. The photograph 210 and the mentioned items 1 10 are priSn fhe ID 
card by a printing device 840. thereby completing the ID card 220. 

a romp's 1 ThAnM 6X k CUtin p processina 01 the ima 9 e Processing device shown in Fig. 16A is stored in 

a ROM 835. The ROM 835 may be replaced by a hard disc, a floppy disc or the like. 
Next, the method of checking the ID card will be described. 

«~ rhe ^ a9e °L th f ID C3rd ° n WhiCh 406 P hoto 9 ra P h embedded with the identification data and the mentioned items 
are printed ,s picked up by the camera 850 shown in Fig 16B and then input to a checking device 870 T^e date S 
are taken ,nto the checking device 870 are processed along the flow of Fig. 15. The read in image data ana se^aTatS 

DCT l^S^S^T T mentioned - item P° rti0 " - the capture ilO. and the these portion ar E£5EX 
DCT unit 320 and the character recognizer 330 respectively. 

ponertas fomLs"" ^ *" frequenCy COmponents are represented in the order from a lower frequency com- 

F(i), F(2). ... F(n) 

"S/TS IT £T 3 i° ca,cu,ates P artial ave rage avg (F(i)) of the absolute values at three neighboring 

s^t^t^^r**" ,rom imaae data is represented by w(i >- and - ^ 2 

W(i) = F(i)/avg(F(i)) 

The adder 360 calculates the total sum WF (i) of the overall image every i for W(i) 

data ^mtnln^'it^ ? h co 9 nizer 330 th * men «°ned items are reproduced as characters from the image 

S^S^fff JK? 1 ? h ? araCt6r reco 9™«on. On the basis of the mentioned-item data from the char- 

:r h ;™e^ :^r 2 ™:^zr«;° genera,es idenwication data havin9 a — a ~ 

WF^X^ 

C = (WFx w)/(WFDxwD) 

Here, 
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WF = (WF(1), WF(2), ... WF(n)), w (w(1), w(2), ... w(n)) 

WFD represents the absolute value of a vector WF, and wD represents the absolute value of a vector w. If the value C 
is not less than a predetermined value, it is judged that there is correlation between the identification data embedded 
5 into the photograph and the mentioned items, and it is displayed on a display 880 that the ID card is true. 
In Fig. 16B, a program for making the checking device 870 perform the operation shown in Fig. 15. 
Next, the case where the ID card is forged will be described. It is the simplest forging way that only the photograph 
on the ID card is replaced by another. In this case, however, when the correlation between the identification data 
extracted from the image data and the mentioned items is checked at the check stage, the value C is approximately 
w equal to zero. This is because the identification data generated on the basis of the mentioned items are not embedded 
into the photograph. Accordingly, it is possible to easily judge that the ID card is forged. 

As another forging way, identification data are generated from mentioned items and embedded into a photograph, 
and then the photograph embedded with the identification data is printed on a card. In this case, the calculation equa- 
tion of a random number for generating the identification data is not known, and identification data which are different 
is from the identification data of the normal (legal) card are generated. Therefore, the value C which indicates the corre- 
lation is equal to zero at the check stage, and thus the card is judged to be forged. 

As another forging way, a photograph is carefully checked pixel by pixel to extract identification data and find out 
the calculation equation. In this case, identification data is inserted into a photograph when it is divided to spatial fre- 
quency components. Accordingly, it is impossible to investigate the identification data from the photograph after IDCT. 
20 That is, the identification data are not embedded into specific pixel portions. 

In the above embodiment, the system which makes it hard to decipher enciphered data is used together with the 
electronic watermark system. In addition to the above systems, a system which makes it harder to decipher enciphered 
data, that is, a system which makes it more difficult to forge ID cards, may be further used as a data hiding system by 
using a data compression method accompanying loss (Lossy Compression), a data compression method accompany- 
25 ing information loss (Lossless Compression) or a spectrum spreading technique. 

[Seventh Embodiment] 

Next, a seventh embodiment according to the present invention will be described. Fig. 17 shows a flow of forming 

30 an ID card which is one type of card type recording medium according to the seventh embodiment. Fig. 18 shows a flow 
of checking the ID card of the seventh embodiment. Fig. 19A shows a system for issuing an ID card according to the 
seventh embodiment, and Fig. 19B shows a system for checking the ID card of the seventh embodiment. 

In the seventh embodiment, the ID card 520 is provided with a magnetic recording portion 530. The name and the 
employee number are recorded at the magnetic recording portion, and also printed on the surface of the ID card. That 

35 is, as shown in Fig. 1 7 and Fig. 1 9A, the process is identical to that of the sixth embodiment until a photograph embed- 
ded with identification data is formed. However, in order to form an ID card, the photograph 1 00 is printed on the IC card, 
and the mentioned items 1 1 0 such as the name and the employee number are embedded as identification data into the 
image data of the photograph while the mentioned items 1 10 (identification data) are directly transformed to magnetic 
recording data, or enciphered and then transformed to magnetic recording data, and then recorded at the magnetic 

40 recording portion 530 by using a magnetic card writer 950. 

With respect to the checking device, the photograph on the ID card 600 is read out by a camera 850 as shown in 
Figs. 18 and 19B in the same manner as the sixth embodiment, and the information on the name, etc. is read in from 
the magnetic recording portion 610 through a magnetic card reader 970. The processing after the read-in is identical to 
that of the sixth embodiment. That is, the photograph is transformed to image data by the capture 310 and subjected to 

45 DCT every block to obtain DCT data. The DCT data is divided by the partial average thereof, and the result is added to 
calculate the total of the overall image WF(i) and calculate the vector inner product of the identification data recorded 
on the magnetic card. On the basis of the calculation result, it is judged whether the holder is a true holder or the ID 
card is forged. 

As described above, the identification data or the data obtained by enciphering the identification data are recorded 
50 on the magnetic stripe portion, thereby making it difficult to recognize the data on the name, etc. on the basis of which 
the identification data are created, and thus the forgery is more difficult. 

In the above embodiment, by using the electronic watermark technique, the forgery is made more difficult. In the 
above embodiment, the identification code is watermarked into the face photograph on the ID card. However, in place 
of the face photograph, a fingerprint or a retina which can specify a personal may be used, and also in place of the iden- 
55 tification data, ID information which respects memories of a personal may be used. 

Further, in the above-described embodiments, it is the top object to judge the coincidence between a card owned 
by a holder and the true card holder on the basis of thelmage^information and the ID information on the card type 
recording medium in combination with the enciphering technique, and these embodiments may be applied to many 
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cards containing novel cards which will be issued in the future, such as a credit card, a telephone card a cash card an 
employee card a student card. a health insurance card. etc. Further, a system using a magnetic action ^whtoh date 
are magnetically recorded on and read out from a magnetic ^ipe is basical.y lower in cost and higheHn relaSy Hot 

ly«e*Z7"Z™^* e ^ t0 ° ther reC ° rdin9 S ^ tems such as an °P« cal ^em. an magfeS^S 
system, etc. It is apparent that the present invention is not limited to the above-described embodiments 

According to the present invention, the ID information can be verified dually on the basis of the information of the 
magne ,c card land I the image information embedded with the ID information. Accordingly, in a card chik work ft £n 
soS ft? 5 "'T* W ^ ° ri9ina ' ^ ™ S * beC3USe ID information .^nnted So 

Further, even when the data at the magnetic portion of the magnetic card are damaged, the confirmation of the ID 

nlreE Z -n T * T™^ When the data are dama 9<* due to SSSS nig 

is £ 11 ST ? ^ OUt t0 jUd9e Wh6ther the card is the ori 9 inal ^cause the ID information 
is printed at the pattern portion of the magnetic card. 

the dZ trm e ^ rdin9 6 r Sent inVenti ° n ' 1,16 10 information can ^ recorded/printed on the magnetic card in 
netic 2 J?£ HiS ■ " ' n . C r b,nat, ? n ° f ma9netiC in,ormation and j ™ge information. Therefore, the copy of the mag- 
netic card is difficult, and thus the forgery of a magnetic card by a third party can be prevented The reason whv such 

third JS ' S r6SideS : n the ,D informati ° n is embedded into lha * attem ° f tha -agn^c catfsc that a^y 

!Sc Srd reC09n ' Ze * ^ ,D information is inserted int0 a P° r «° n o*er than the magnetic portion of tha mag- 

pnri^rin S ; e Wit ? l ° whicn * manufactured according to the magnetic card ID information 

enc phenng system of the present invention, when only the magnetic information is copied, the magnetic card is iudaS 
not to be identical to the original card unless the pattern portion is copied. Therefore the forgeTy of th^ S 
is extremely difficult It is very difficult to a nonprofessional to find that the ID information is embedded ^^nToTe pattern 
SSTTiEirT" 6 ,reqUenCy COmpor5ents ^ponding to the original image pattern of the pattern is stronger 
ince SIS? U ^ uen Z^ mp ° nentS ««Wndino to the ID information. Even if a nonprofessional finds the differ- 
ence therebetween, any body cannot imitate the ID card unless the original pattern is obtained 

the loTntorma^n ^nlTL'T *J? ™?T* C ° f the magnetic is broken - the confirmation of 

the ID intormatoon can be easily performed. Accordingly, even when the magnetic information is damaged by an exter- 

32ta?h ,D in f r' 0 ? mb6dded int ° thepattem iS fead t0 ea ** restore » e ID informa'Sn of "e mag- 
Snn an Z Tn «? an /" eCt 03,1 be 0btain6d b6CaUSe Pattern P° rtion is not by the external magnefic 

^magnetic faSo" ****** ^ * by ma9ne,ic aCtion and thus not *ma£d * 

Still further by applying the present invention, it is difficult to forge an ID card which is one kind of card tvoe record- 
ing medium of the present invention. For example, even when the face photograph of an ID card i repSed b another 

as beTng Ced. 00 " 6 " ** ^ " *" Ph ° t09raph ' ™« W^S^SSSi 

tern o?l , e U S^^f n9 ^ edi T °* inVent, '° n ' S St ° red the program ,or enab,ina the ch «**9 ^ys- 

ZZll tZi^ 7 9 ?T t0 ° Perafe ' n the Same pr0CesS by a microcomputer or the like. Therefore, not 
S*ri?SSSL? ,nf0 T ati0n such as flnaerprirtE. faces, etc.. but also management of copyrighted 

works, etc. can be performed with simple facilities. y 

Claims 

1 . A card type recording medium comprising: 

a data area where data containing ID information of a holder are recorded; and 
an image area where image data are recorded; 

inn f irct^ in H C T tentS ^ * e ^ *** m reCOrded Second ima 9 e data which «™ generated by transform- 
^ 6 h ° ,der t0 frec ^ uenc y area data « a ^ing the transformed frequency-area data 
with the ID information and inversely transforming the added data to image signals. 



2. 



3. 



is a ?oSe e r fran^ mediUm ^ " 1 ' thS COnVerSl ° n prOCe5Sln 9 ^ *• frequency-area 

Stn?c^ P ! reCOrdin ? m ! dium as dalmed in daim 1. wherein the conversion processing to the frequency-area 
data is discrete cosine transform which is performed on each of blocks into which the first image datTiitfiS 
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4. A card type recording medium comprising: 

a data area where data containing ID information inherent to a holder are recorded; and 
an image area where image data are recorded, wherein said image area are recorded second image data 
5 which are generated by transforming first image data specifying the holder to frequency-area data, adding the 

transformed frequency-area data with data obtained by transforming the ID information to frequency-area infor- 
mation, and inversely transforming the added data to image signals. 

5. The recording medium as claimed in any one of claims 1 to 4, 

10 wherein the ID information of the data area are enciphered and recorded. 

6. The medium as claimed in any one of claims 1 to 5, 

wherein the first image data is a fingerprint image of the holder. 

15 7. The medium as claimed in any one of claims 1 to 5, 

wherein the first image data is a face photograph image of the holder. 

8. A method of certifying a card type recording medium which contains a data area where data containing ID informa- 
tion of a holder are recorded, and an image area where image data are recorded, in the image area being recorded 
20 second image data which are generated by transforming first image data specifying the holder to frequency-area 
data, adding the transformed frequency-area data with the ID information and inversely transforming the added 
data to image signals, comprising: 

a first step for restoring the ID information from said card type recording medium and reading data of the image 
25 area; 

a second step for transforming the image-area data to the frequency-area data to generate first transformed 
image data; 

a third step for gaining the same data as the first image data from a reading target other than said recording 
medium and transforming the image data thus gained to the frequency-area data to obtain second transformed 
30 image data; and 

a fourth step for subtracting the second transformed image data from the first transformed image data to obtain 
differential data, and comparing the differential data with the ID information restored from said card type 
recording medium to judge whether said recording medium is justifiable. 

35 9. The method as claimed in claim 8 , wherein the conversion to the frequency-area data is Fourier transform. 

10. The method as claimed in claim 8 , wherein the conversion to the frequency-area data is discrete cosine transform 
which is performed on each of plural blocks into which the first image data are divided. 

40 11. The method as claimed in claim 8, 9 or 1 0, wherein said fourth step compares the differential data obtained every 
block with the ID information restored from said card type recording medium to perform the judgment on the basis 
of majority voting of the comparison result. 

An apparatus for certifying a card type recording medium which contains a data area where data containing ID 
information of a holder are recorded, and an image area where image data are recorded, in the image area being 
recorded second image data which are generated by transforming first image data specifying the holder to fre- 
quency-area data, adding the transformed frequency-area data with the ID information and inversely transforming 
the added data to image signals, comprising: 

50 an ID information reader for restoring the ID information from said card type recording medium; 

an image reader of reading the image-area data; 

a conversion unit for transforming the image-area data to the frequency-area data to generate first transformed 
image data; 

a second image reader for reading the same image data as the first image data from a reading target other 
55 than said recording medium; 

a second conversion unit for transforming the image data thus obtained to the frequency-area data to obtain 
second transformed image data; *' ^ ^ 

a subtracter for subtracting the second transformed image data from the first transformed image data to obtain 
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differential data; and 

a judgment circuit for comparing the differential data with the ID information restored from said card type 
recording medium to judge whether said card type Voiding medium is justifiable. 

s 1 3. A card type recording medium enciphering system including enciphering means for enciphering ID information to 
be recorded on a magnetic card, and magnetic information forming means for recording the enciphered ID informa- 
tion as magnetic information on said magnetic card, comprising: 

io Scrard d ° main ,ranSf0rmation means ,or transforming an original image pattern of a pattern of said mag- 

adding means for transforming ID information to be.recorded on said magnetic card to transformation informa- 
t.on in which the ID information is distributed on a frequency domain, and adding the transformation information 
with the information which is generated by the transformation of said frequency domain transformation means 
frequency domain inverse transformation means for restoring the information of the frequency domain gener- 
ated by the addition of said adding means to a two-dimensional image pattern; and 

image pattern print means for printing the image pattern generated by said frequency domain inverse transfor- 
mation means on said magnetic card so that the image pattern is used as the pattern of said magnetic card. 

14. The card type recording medium enciphering system as claimed in claim 13 . further adding means for generating 
an ID information frequency spectrum so that the ID information frequency spectrum is similar to the distribution 
state of the original image frequency spectrum which is the information of the frequency domain generated by the 
transformation of said frequency domain transformation means, and adding the original image frequency spectrum 
and the ID information frequency spectrum. 

1 5. The card type recording medium enciphering system as claimed in claim 13 or 14. wherein said frequency domain 
transformation means performs FFT. and said frequency domain inverse transformation means performs inverse 
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The card type recording medium enciphering system as claimed in claim 13 or 14. wherein said frequency domain 
transformation means performs DCT. and said frequency domain inverse transformation means performs inverse 
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17. A card type recording medium decoder for a recording medium on which enciphered ID information and an image 
pattern containing ID information are printed, comprising: 

a magnetic reader for reading the enciphered ID information from a magnetic stripe of said recording medium- 
frequency domain transformation means for transforming the pattern of said magnetic card to frequency 
domain information by a magnetic head; 

deciphering means for deciphering the enciphered ID information and outputting ID information- 
image reading means for reading the image pattern; 

frequency domain transformation means for transforming the image pattern to frequency domain- 
a subtracter for subtracting from the frequency domain data frequency domain information to which the ID 
information is transformed; and 

frequency domain inverse transformation means for restoring the frequency domain information generated by 
the subtraction of said subtracter to a two<fimensional image pattern. 

18. A card type recording medium in which specific data for specifying a holder are written, comprising: 

identification data generated on the basis of the specific data which are embedded into spatial frequency data 
50 of a photograph; and ' 

the spatial frequency data embedded with the identification data which are inversely transformed to time data 
to generate image data and further record the image data thus generated. 

19. The card type recording medium as claimed in claim 18 . wherein the spatial frequency data is a photograph imaae 
which ,s subjected to discrete cosine transform, and the inverse transformation^ inverse discrete cSeTanS 

2 °" n^ll^ 8 re °j )rding m6dium 35 Claimed in c,aim 18 or 19 • wherein ,he SP*^ frequency data embedded with 
the identrf . cation data are generated by multiplying each component of the spatial frequency data of the photograph 



16 

NSDOCID: <EP 08S1397A2 I =. 



EP 0 851 397 A2 



data and the component corresponding to the identification data, then multiplying the multiplication result and a 
constant value, and then adding the constant-multiplied value to the component corresponding to the spatial fre- 
quency data of the identification data. 

21. The medium as claimed in claim 18, 19 or 20, 

wherein the specific data are written in a magnetic recording medium. 

22. The medium as claimed in any one of claims 18 to 21, 

wherein said card type recording medium is used as an ID card or a credit card. 

23. A card type recording medium forming system comprising: 

means for generating identification data on the basis of specific data for specifying a holder; 
means for transforming a photograph to be attached onto said card to spatial frequency data; 
means for multiplying each component of the spatial frequency data and the component corresponding to the 
identification data, and adding a value obtained by multiplying the multiplication value and a constant to the 
component corresponding to the spatial frequency data of the photograph data, and then inversely transform- 
ing the added spatial frequency data to image data; and 

means for writing the image data and the specific data on said card type recording medium. 

24. The card type recording medium as claimed in claim 23, wherein the transformation is discrete cosine transform, 
and the inverse transform is inverse discrete cosine transform. 

25. A card type recording medium certifying device for certifying a card type recording medium in which identification 
data generated on the basis of the specific data are embedded into spatial frequency data of a photograph, then 
the spatial frequency data embedded with the identification data are inversely transformed to time data to generate 
image data, and then the image data are recorded together with the specific data, comprising: 

means for generating the identification data on the basis of the specific data; 
transformation means for transforming the image data to the spatial frequency data; and 
means for performing a correlation calculation between the output of said transformation means and the iden- 
tification data and judging on the basis of the correlation calculation result whether the card type recording 
medium is true or not. 

26. A recording medium for storing a program for operating a card type recording medium forming system in a compu- 
ter, wherein said program contains: 

a step of generating identification data on the basis of specific data specifying a holder; 
a step of transforming a photograph to be attached to spatial frequency data; 

a step of multiplying each component of the spatial frequency data and the component corresponding to the 
identification data, and adding a value obtained by multiplying the multiplication value and a constant to the 
component corresponding to the spatial frequency data of the photograph image, and inversely transforming 
the added spatial frequency data to image data; and 

a step of writing the image data and the specific data on the card type recording medium. 

27. The recording medium as claimed in claim 26, wherein the transformation is discrete cosine transform, and the 
inverse transformation is inverse discrete cosine transform. 

28. A recording medium for storing a program for operating in a computer a checking system for a card type recording 
medium in which identification data generated on the basis of the specific data are embedded into spatial frequency 
data of a photograph, then the spatial frequency data embedded with the identification data are inversely trans- 
formed to time data to generate image data, and then the image data are recorded together with the specific data, 
comprising: 

a step of generating the identification data on the basis of the specific data; 
a step of transforming the image data to the spatial frequency data; and 

a step of performing a correlation calculation bettfee^uttje output of said transformation means and the identi- 
fication data and judging on the basis of the correlation calculation result whether the card type recording 
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